An Artificial Frustrated System: Cold Atoms in 2D Triangular Optical Lattice 
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We investigate the strongly correlated effect of cold atoms in triangular optical lattice by dynam- 
ical cluster approximation combining with continuous time quantum Monte Carlo method. When 
the interaction increases, Fermi surface evolves from a circular ring into a flat elliptical ring, system 
translates from Fermi liquid into Mott insulator. The transition between Fermi liquid and pseudo- 
gap shows a reentrant behavior due to Kondo effect. We give an experimental protocol to observe 
these phenomena by varying lattice depth and atomic interaction via Feshbach resonance in future 
experiments. 

PACS numbers: 67.85.-d, 03.75.Hh, 03.75.Ss, 71.10.Fd 



I. INTRODUCTION 

Quantum phase transition in strongly correlated sys- 
tem is an important research area in condensed matter 
physics, presenting some of the most challenging prob- 
lems. In a real material, the experimental parameter 
is hard to be varied to observe the strongly correlated 
effect, which is complicated by impurities and multiple 
bands. However, a new developing technology called op- 
tical lattices presents a highly controllable and clean sys- 
tem for studying strongly correlated system, in which the 
relevant parameter can be adjusted independently [ll- 
@]. Optical lattices with different geometrical property 
can be set up by adjusting the propagation directions of 
laser beams, such as triangular [7], honeycomb [8| and 
kagome [§-[l2| optical lattice. The interaction between 
the trapped atoms is tunable through the Feshbach res- 
onance, such as ^Li and ^^K. In recent years, a series 
of experiments have been carried out to investigate the 
quantum phase transition of cold atoms in optical lattice 

[iMil. 

There are many analytical and numerical methods to 
investigate the str ongly c orrelated system, especially the 
frustrated system |2Q|-[29J . The dynamical mean- field the- 
ory (DMFT) [30| has been proved to be a useful tool. 
The self-energy is given as a local quantity in DMFT, 
which has been proved to be exact in the infinity dimen- 
sional limit [31| . This method is a good approximation 
even in three dimensional situation [32|- However, in the 
frustrated systems, the nonlocal correlations can not be 
simply ignored, DMFT would not work efficiently. So, 
many methods have been improved to incorporate non- 
local correlations in the framework of DMFT, such as 
dynamical cluster approximation (DC A) |33i, .3^. Differ- 
ent with the DMFT, the lattice problem is mapped into 
a self-consistently embedded finite-sized cluster in DCA. 
The irreducible quantities of the embedded cluster is used 
as an approximation for the corresponding lattice quan- 
tities. DCA has been used to investigate the geometrical 
frustrated system [35|, 36]. 

In present Letter, we investigate the Mott transition 
in an artificial frustrated system - cold atoms in triangu- 




FIG. 1: (Color online) (a) Sketch of experimental setup to 
form triangular optical lattice. Each arrow depicts a laser 
beam, the sphere in center of the figure depicts the fermionic 
quantum gas, such as ^^K. (b) Landscape of potential 
V{x^y). (c) The contour lines of triangular optical lattice. 
The dark blue circles indicate the minimum lattice potential. 
The dash red lines show the geometry of this triangular opti- 
cal lattice by connecting the minimum lattice potential. 



lar optical lattice. We improve the numerical method 
- DCA combining with the continuous time quantum 
Monte Carlo method (CTQMC) [s^ to investigate this 
geometrical frustrated system. CTQMC, used as the im- 
purity solver, is an exact numerical method proposed 
recently. By calculating the density of states and the 
spectral function, we find the system undergoes a second 
order phase transition from Fermi liquid to Mott insu- 
lator. The phase diagram shows a reentrant behavior of 
the transition between Fermi liquid and pseudogap due to 




FIG. 2: (Color online) (a) Sketch of triangular lattice, (b) 
Coarse graining procedure in the first Brillouin Zone when 
iVc = 4. The red part shows the first Brillouin Zone in recip- 
rocal space. The green part shows the region divided into 4 
cells for DC A calculation. 



the Kondo effect at low temperature. These phenomena 
can be observed in the triangular optical lattice by vary- 
ing the lattice depth and the interaction strength via the 
Feshbach resonance. The advantage of this artificial frus- 
trated system is highly controllable and cleanness. And 
the numerical method acts as a powerful tool for investi- 
gating the strongly correlated effect in condensed matter 
physics, such as the spin liquid, the high-temperature 
superconductor and the colossal magnetoresistance. 



II. ARTIFICIAL FRUSTRATED SYSTEM 



& 



I 



0.12 


\ 


■ 


' 


OOA 


\ 


-*-TiMJd 




0.04 
0.00 


I.I. 


1 


1 — 



12 



Ifl 



2D 



UA 



FIG. 3: (Color online) The double occupancy Docc as a func- 
tion of the interaction U for different temperature, t is the 
kinetic energy in equation (2). 



where cjt and Cj. 



denote the creation and the 
ferminic 



an- 
nihilation operator of the ferminic atom on lat- 
tice site i respectively, riia- = cl^Cia- represents 
the density operator of ferminic atom. And t = 
{4/,/^)Er{Vo/Er)^/^exp{-2{Vo/Ery/^) is the kinetic 
energy, which can be adjusted by the lattice depth Vq. 
U = y^8/7rkasEr{Vo/Er)^^^ is the on-site interaction de- 
termined by the s-wave scattering length o^ which can 
be adjusted by Feshbach resonance [O. l38l. l39j . 



In contrast with real materials, the cold atoms trapped 
in an optical lattice provide an artificial system to inves- 
tigate the strongly correlated effect. The experiment can 
be performed with ^^K atoms prepared by mixing two 
magnetic sublevels of the F = 9/2 hyperfine manifold, 
such as the | - 9/2) and the | - 5/2) states ^. As 
an artificial frustrated system, the triangular optical lat- 
tice can be set up by three laser beams, such as the Yb 
fiber laser at wavelength A = 1064 nm, with a 27r/3 an- 
gle between each other, as illustrated in Fig. 1(a). The 
potential of optical lattice is given by 



V{x,y) = Vo{3 + icos{'^)cos{^^ 



)+2cos(\/3fcyt/)), 

(1) 

where Vq is the barrier height of standing wave formed 
by laser beams in the x-y plane, kx and ky are the two 
components of wave vector k = 27r/A along x and y direc- 
tions. In experiments, Vq is always given in units of recoil 
energy Er = h'^k'^/2m. The landscape of potential of tri- 
angular optical lattice in the x-y plane is shown in Fig. 
1(b), where the dark blue parts in the figure indicate the 
minimum lattice potential. Fig. 1(c) shows the contour 
lines of the triangular optical lattice. By connecting the 
center of the circular which indicates the minimum lat- 
tice potential, we may get the geometry of this triangular 
optical lattice, as shown by the red dash lines. 

The Hamilitonian of the interacting fermionic atoms 
trapped in this artificial frustrated system is written as 



H = -t 



ctci 



<ij>(T 



^E 



rii^riii, 



(2) 



III. NUMERICAL METHOD: DCA-hCTQMC 

We improve the dynamical cluster approximation 
(DCA) to combine with the continuous time Quan- 
tum Monte Carlo method (CTQMC) to investigate the 
strongly correlated effect of cold atoms in the frustrated 
system shown in Fig. 2(a), which can be realized by 
Hubbard model (2). 

In DCA, the reciprocal space of the lattice containing 
N points is divided into finite cells [3^. The coarse- 
graining Green's function G is achieved by averaging 
Green's function G within each cell. The lattice problem 
is mapped into a self-consistently embedded finite-sized 
cluster. The coarse graining procedure of the DCA is il- 
lustrated as follows: the Brillouin zone is divided into Nc 
cells, each cell is represented by a cluster momentum K. 
In Fig. 2(b), we provide an example of this coarse grain- 
ing procedure in iVc = 4 situation. In our treatment, the 
coarse-grained Green's function 



_ NCy. 



~ lUJn 



n -^It+k - ^a(K,ZCJn) 



(3) 



where summation over k is taken within the coarse- 
graining cell, the uon is the Matsubara frequency. 

Similar with DMFT, after mapping the Hubbard 
model to an Anderson impurity problem, we introduce 
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FIG. 4: (Color online) The density of states (DOS) as a func- 
tion of frequency uj for different interaction, t is the kinetic en- 
ergy in equation (2). (a) At T /t = 0.50, a pseudogap formed 
by the splitting of Fermi- liquid- like peak appears when the 
interaction increases. A gap is opened when the interaction 
is stronger than the critical interaction Uc/t — 11.6. (b) At 
T /t — 0.25, a Kondo resonance peak is found before the pseu- 
dogap appears. 



an impurity solver to solve the cluster problem, such as 
quantum Monte Carlo (QMC), fluctuation exchange ap- 
proximate (FLEX), and the noncrossing approximation 
(NCA). In our calculation, we employ the CTQMC [s^ 
which does not need to introduce any anxiliary-field vari- 
ables as our impurity solver. Comparing with the tradi- 
tional QMC method, the CTQMC is much more exact, 
because it does not use the Trotter decomposition. We 
use 10^ sweeps in our CTQMC step. 

The self-consist loop can be taken as follows: 

1) The DC A iteration loop can be started by setting 

the initial self-energy Ec(K,zcJn) which can be guessed 
or be get from a perturbation theory. 

2) We could get: 

3) The host Green's function ^(K,icJn) is computed 

by a(i^, iuJn)-^ = G(i^, iuJn)-^ + Sc(i^, iuJn)- 

4) The ^(K,zcJn) is transformed from momentum- 
frequency variable to space- time variable ^( A^ — A j , ti — 
Tj) used as the input to the CTQMC simulation. 

5) The CTQMC step is the most time consuming part 
of the iteration loop. In our CTQMC step, we use 10^ 
CTQMC sweeps. After the simulation, we get G(a^ — 
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FIG. 5: (Color online) The K-dependent spectral function 
Ak{uj) for different temperature, when U/t — 7.0. t is the 
kinetic energy in equation (2). (a) At T/t = 1.67, the red 
part shows a Fermi- liquid- like peak near Fermi energy, (b) 
At T/t = 1.11, a narrow pesudogap shown by green region. 
Two peak found around the pesudogap is shown by yellow 
and orange color, (c) At T/t = 0.5, a Fermi- liquid- like peak 
appears again shown by red color, (d) At T/t = 0.2, an 
obvious Kondo peak appears shown by red color. 



^j^Ti -Tj). 

6) G(Ai — ^j^Ti — Tj) is transformed from space-time 

variable to momentum- frequency variable GCK^iUn) by 
Fourier transform. 

7) We get the new self-energy by Ec(K,icJn) = 

g{K,iuJn)-^ -G{^,iuJn)-\ 

8) Repeat from step 2) to step 7) until Ec(K,zcJn) 
converges to desired accuracy. 

9) Once convergence is reached, we can calculate the 
state density p{uj) by maximum entropy method J4Q| . 
And we can get other lattice quantities by some other 
additional analysis code. 

By combining the DCA, which introduces the nonlocal 
correlations, and the exact numerical method: CTQMC, 
we can investigate the frustrated system efficiently. This 
numerical method can be easily reconstructed to study 
another strong correlated system in the future research. 



IV. PHASE DIAGRAM 



We investigate the double occupancy Dqcc = dF/dU = 
Z ^ii'^it^ii) ^s ^ function of interaction U for various 
temperature, where F is the free energy. When the in- 
teraction is lower than U/t = 8.6, the Dqcc increases as 
the temperature decreases due to the enhancing of the 
itinerancy of atoms, as shown in Fig. 3. When the in- 
teraction is stronger than U/t = 8.6, the effect of the 
temperature on Docc is weakened. The Docc decreases 
as the interaction increases due to the suppressing of the 
itinerancy of the atoms. When the interaction is stronger 
than the critical interaction of the Mott transition, Docc 
for different temperature is coincident, which shows the 
temperature does not affect the double occupancy dis- 




FIG. 6: (Color online) The Fermi surface as a function of 
momentum k for different interaction at T/t — 1.25: (1) 
U/t = 5.0, (2) U/t = 10.0, (3) U/t = 16.0. t is the kinetic 
energy in equation (2). 



tinctly. The continuity of the evolution of the double 
occupancy by interaction shows that it is a second order 
transition. 

We employ the maximum entropy method ^0| to cal- 
culate the density of states (DOS) which describes the 
number of states at frequency uj. Fig. 4(a) shows DOS 
for different interaction at T/t = 0.5. There is a Fermi- 
liquid-like peak when U/t = 4.0. A pseudogap formed by 
the splitting of Fermi- liquid- like peak appears when the 
interaction increases, such as U/t = 8.0 and U/t = 9.0. 
When the interaction is stronger than the critical inter- 
action Uc/t = 11.6, such as U/t = 12.0 and U/t = 20.0, 
the system becomes an insulator indicated by an opened 
gap. DOS for different interaction at T/t = 0.25 is shown 
in Fig. 4(b). When U/t = 4.0, there is also a Fermi- 
liquid-like peak. When the interaction increases, such 
as U/t = 8.0, a Kondo resonance peak appears which is 
shown by a sharp quasi-particle peak with two shoulders. 
When U/t = 9.3, the Kondo resonance peak is suppressed 
and a pseudogap appears, which is the intermediary state 
between the Fermi liquid and the Mott insulator. A gap 
is opened when the interaction is stronger than the crit- 
ical interaction Uc/t = 10.6. Instead of directly splitting 
into two parts shown in Fig. 4(a), a Kondo peak appears, 
which is formed by the effect between the local atom and 
the itinerant atom at low temperature, as shown in Fig. 
4(b). 

We could also get the K-dependent spectral function 
Ak{uj) = —ImGki^ + '^0)/7r, which describes the distri- 
bution probability of the quasi-particle with momentum 
k and energy uj. Fig. 5 shows Ak{oj) for different tem- 
perature, where U/t = 7.0. At T/t = 1.67, there exists a 
quasi-particle peak which shows a metallic behavior, as 
shown in Fig. 5(a). In Fig. 5(b), a pseudogap appears 
at T/t = 1.11, which is formed by the splitting of the 
quasi-particle peak. When T/t = 0.50, the pseudogap 
disappears and there is a quasi-particle peak again, as 
shown in Fig. 5(c). An obvious Kondo peak appears 
when T/t = 0.2, as shown in Fig. 5(d). It shows a reen- 
trant behavior in the transition between Fermi liquid and 




FIG. 7: (Color online) The phase diagram of Fermi atoms in 
triangular optical lattice, where the square plots with solid 
line (green, red, blue) indicate the transition line of the Fermi 
liquid and the pseudogap, the circular plots with solid line 
(purple) indicate the Mott transition line, the triangular plots 
with dash line (pink) mark the Kondo peak appearing region. 
t is the kinetic energy in equation (2). 



pseudogap when the interaction is fixed and the temper- 
ature decreases. This behavior is based on the Kondo 
effect which suppresses the splitting of the quasi-particle 
peak at low temperature. 

We study the Fermi surface as a function of momentum 
k by A{k;uj = 0) ~ — - lim^^^o ^^^G(/c,zco'n). A linear 
extrapolation of the first two Matsubara frequencies is 
used to estimate the self-energy to zero frequency J41| . 
Fig. 6 shows the Fermi surface for different interaction 
at T/t = 1.25. A circular ring which means the par- 
ticles distribute on a certain energy displays a metallic 
behavior, as shown in Fig. 6(la). As the interaction in- 
creases, the ring becomes bigger, as shown in Fig. 6 (2a). 
When the interaction is stronger than the critical interac- 
tion U/t = 13.7, the Fermi surface becomes a nearly flat 
plane, as shown in Fig. 6 (3a). From Fig. 6 (lb) to Fig. 
6 (3b), we can find the amplitude of the spectral weight 
becomes small and the breadth become wider. The Fermi 
surface translates from a determined surface into a flat 
plane due to the localization of the particles when the 
interaction increases. 

The phase diagram of cold atoms trapped in triangu- 
lar optical lattice is shown in Fig. 7, where a^ indicates 
the s-wave scattering length. The translation between 
the Fermi liquid and the pseudogap shows a reentrant 
behavior. For a fixed interaction weaker than U/t = 7.2, 
when the temperature decreases, the system translates 
from Fermi liquid to pseudogap. When the tempera- 
ture is lower than the critical temperature distributing 
on the red solid line, the system translates from pesudo- 
gap to Fermi liquid. There is a Kondo peak region, which 
is signed by the blue solid line and the pink dash line. 
If temperature is lower than T/t = 2.0, a Kondo peak 
emerges before the appearing of the pseudogap when the 
interaction increases. When the interaction is stronger 
than the critical interaction of Mott transition distribut- 



ing on the purple line, the system translates from pseu- 
dogap to insulator confirmed by an opened gap. 



V. EXPERIMENTAL PROTOCOL 

We design an experiment to investigate the quantum 
phase transition in triangular optical lattice. The exper- 
imental protocol can be taken as follows: The "^^K atoms 
can be firstly produced to be a pure fermion condensate 
by evaporative cooling [42|. Three laser beams at wave- 
length A = 1064 nm are used to form the triangular op- 
tical lattice |43|] to trap "^^K atoms. The lattice depth Vq 
is used to adjust the kinetic energy t and the interaction 
U. The on-site interaction can be adjusted by Feshbach 
resonance [43448J. The s-wave scattering length is used 
to determine the effective interaction. The temperature 
can be extracted from time-of-flight images by means of 
Fermi fits in experiment [19[. 

When the interaction increases, the system translates 
from Fermi liquid (as < 48ao) to Mott insulator (a^ > 
lllao) at temperature T = 5.96ni^, when Vq = 10 Er. 
In order to detect the double occupancy Dqcc^ we in- 
crease the depth of optical lattice rapidly to prevent the 
further tunnelling first. Then, we shift the energy of 
atoms on doubly occupied sites by approaching a Fesh- 
bach resonance. And then, one spin component of atoms 
on the double occupied sites is transferred to a unpopu- 
lated magnetic sublevel by using a radio- frequency pulse. 
The double occupancy can be deduced by the fraction of 
transformed atoms obtained by the absorption imagining 
[H, Sil. At T = 5.96nK, Docc decreases from 0.11009 
[as = 45ao) to 0.00456 {as = 130ao) with increasing 
atomic interaction. 



By ramping down the optical lattice slowly enough, 
the atoms stay adiabatically in the lowest band while 
the quasi-momentum is approximately conserved. Then, 
the optical lattice is converted from a deep one into a 
shallow one and the quasi-momentum is preserved. After 
completely turning off the confining potential, the atoms 
ballistically expand for several milliseconds. Then by the 
absorption imagining, one can get the Fermi surface [50|, 
51]. At T = 5.96ni^, the circular ring shape of the Fermi 
surface when a^ = 41ao transforms into a fiat plane when 
as = 162ao. 



VI. SUMMARY 

In summary, we investigate the Mott transition of the 
cold atoms in 2D triangular optical lattice set up by three 
laser beams. The system evolves from Fermi liquid into 
Mott insulator for increasing interaction, and a reentrant 
behavior of the transition between Fermi liquid and pe- 
sudogap is found, due to the Kondo effect. Our study 
presents a helpful step for understanding the strong cor- 
related effect in the frustrated system, such as the spin 
liquid. Beyond DMFT, DCA is improved to incorporated 
the nonlocal correlation which can not be simply ignored 
in the frustrated system. This numerical method is uni- 
versally to investigate strongly correlated system, such 
as the high-temperature superconductor and the colossal 
magnetoresistance. 
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